MSA- CR-nx^HX 


NASA Contractor Report 172542 nasa-cr-i 725 M 

19850012421 

ICASE REPORT NO. 85-10 

For Pleference 


ICASE 


COMPLEX SYMMETRIC MATRICES WITH STRONGLY STABLE ITERATES 


Eitan Tadmor 


Contract No. NAS1-17070 
February 1985 


INSTITUTE FOR COMPUTER APPLICATIONS IN SCIENCE AND ENGINEERING 
NASA Langley Research Center, Hampton, Virginia 23665 

Operated by the Universities Space Research Association 


NASA 

National Aeronautics and 
Space Administration 

Langley Research Center 

Hampton. Virginia 23665 



.LANGLEY RESEARCH CENTER 
LIBRARY, NASA 
HAMPTON, VIRGINIA 




COMPLEX SYMMETRIC MATRICES WITH STRONGLY STABLE ITERATES 


Eitan Tadmor 

School of Mathematical Sciences, Tel-Aviv University 

and 

Institute for Computer Applications in Science and Engineering 


Abstract 

We study complex-valued symmetric matrices. A simple expression for the 
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invariant form. Consequently, we provide a sharp criterion for identifying 
those symmetric matrices whose spectral norm is not exceeding one: such 
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we apply the derived criterion to conclude the strong stability of a Lax- 
Wendroff scheme. 
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1. Introduction 


We study complex symmetric matrices, i.e., matrices C whose entries, 
Cj^., are complex-valued, and which coincide with their real transpose, Cj^ = 

C kj‘ 

Such matrices arise, for example, as the amplification matrices 
associated with convergent difference approximations to (symmetric) partial 
differential equations: indeed, the stability question of the latter is 

governed by the power-boundedness of such complex symmetric amplification 
matrices C. In 1964 Lax and Wendroff [11] were first to utilize numerical 
radius techniques, in order to prove stability of their schemes by verifying 

Max | x Cx | _< 1 • (1.1) 

* “ 
x x=l 

Halmos^ inequality can be used to conclude that the powers of C are then 
uniformly bounded by 2, e.g. [4, 5, 9]. A stronger sufficient criterion for 
power-boundedness is provided by the inequality 

Max | x C Cx | <. 1 • (1.2) 

* ~~ 

X X=1 

Indeed, by the submultiplicativity of the spectral norm , the matrix C has 
strongly stable iterates in this case; all are uniformly bounded by 1. Such 
strongly stable schemes are usually sought in connection with problems 
admitting variable and nonlinear coefficients, splitting techniques, etc., 
e.g. [1, 14, 17] and in particular [10]. 

Unfortunately, calculating the spectral norm of a matrix may prove itself 
as a complicated task, due to the quadratic appearance of C on the right of 
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(1.2). In the next section we recall the canonical Schur's representation of 
such complex symmetric matrices, C = C l , which yields a more favorable 
expression for their spectral norm 

Max [x^CxI • 

* 

x x=l 

The latter expression shares the same advantage of the numerical radius in 

(1.1); namely, both involve linear form dependence on the matrix C. 

Consequently, we are able in Section 3 below to conclude with a sharp, 

relatively simple criterion for checking the strong stability of complex 

* 

symmetric matrices, C C < I; specifically, in Section 4 it is recast into the 
requirement 

(x*Kx) • (y*Ky) £ 2*x*Kx - (y*Jx) 2 , x*x = y*y = 1 

where -K and J are respectively the real and imaginary parts of C-I. As 
an example, this criterion is then applied to prove the strong stability of 
the (modified) Lax-Wendroff scheme studied in [11]. 
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2. Symmetry Invariance Under Unitary Congruence 

Let <f n be the space of n-column complex vectors. Given a vector x 
in $ n , we set x y x* 1 and x* = x*" to denote, respectively, the (complex) 
conjugate, the transpose, and the (complex) conjugate transpose of that 
vector x. Similar notations are used for matrices. 

A 

Let (x,y) = y x stand for the usual Euclidean inner product and let 
C be a given matrix in M^^) “ the algebra of n x n complex-valued 

matrices. Among other quantities used to measure the size of a matrix C, we 
have its spectral norm - which will be temporarily denoted N(C), 

N(C) = Max |(Cx,y)| (2.1) 

M-M-i 

and its numerical and spectral radii given respectively by 

r(C) = Max |(Cx,x)|, (2.2) 

M-i 

p(C) = Max I X | . (2.3) 

Cx= Xx , | x | = 1 

Those three quantities admit the following hierarchy of inequalities, valid 
for all C in M n (<£) 


p(C) < r(C) N(C). (2.4) 

When does equality take place? In connection with this question one observes 
that, e.g. [4, 5, 9] 

(i) equality holds for all diagonal matrices A 
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P ( A) = r( A) = N( A) , 

and 

(ii) each of the three quantities is invariant under unitary similarities; 
that is, for every unitary U, U U = I n and all C in M n ((f:) 


N(C) = N(U*CU) 

(2.5a) 

r(C) = r(U*CU) 

(2.5b) 

p(c) = p(U*CU). 

(2.5c) 


As a consequence of the last two observations, equality in (2.4) follows 
for all matrices C which are unitarily similar to diagonal ones, namely, 
normal matrices 

p(C) = r (C) = N(C), C*C = CC*. (2.6) 

In general, matrices satisfying the equality on the left of (2.6) - that 
is, equality between their spectral and numerical radii - are called spectral 
matrices after Halmos [9, p. 115]; such matrices were completely characterized 
in [6, 7]. Special cases are the radial matrices [9] - those having equal 
spectral radius and norm [2, 8, 13]. According to this terminology, we have 
seen that the class of normal and, in particular, real symmetric matrices, is 
contained in the radial class; indeed, it is a proper subclass of the latter 
[4, 8]. 
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Yet, the class of complex symmetric matrices which we are interested in 
here is included in none of the above. This is essentially due to the fact 
that this class is not invariant under unitary similarities. Rather, the 
symmetry of (complex-valued) matrices is invariant under (transposed-type) 
congruence: if C coincides with its transpose, so does U t CU, This 

motivates our discussion below, regarding the slightly different analogue 
quantities of what we had before and which are more adequate for our purposes 
of studying complex symmetric matrices. 

To begin with, we introduce for an arbitrary matrix C in ^((j;), the 
associated congruent-type quantities, namely, the congruent-type norm , Nc(C), 

Nc(C) = Max |(Cx,y)l (2,7) 

W-M-i 

and the congruent- type numerical and spectral radii, given respectively by 

rc(C) = Max |(Cx,x)| (2.8) 

|x|=l 

pc(C) = Max |X|. (2.9) 

Cx= Xx , | x | = 1 

As before, we have the analogue hierarchy of inequalities, valued for all 
matrices C in M n (^), 


pc(C) < rc(C) < Nc(C) • (2.10) 

Seeking equality in (2.10), then rather standard arguments which we omit, lead 


us to 
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(i) equality holds for all diagonal matrices A 

pc(A) = rc(A) = Nc(A), 
and, in the heart of the matter, 

(ii) each of the three (congruent-type) quantities is invariant under 
unitary congruence ; that is, for every unitary U, U*U = I and all 
C in M^) 


Nc(C) = Nc(U t CU) (2.11a) 

rc(C) = rc(U t CU) (2.11b) 

pc(C) = pc(U t CU) . (2.11c) 

Hence, equality in (2.10) follows for all matrices C which are unitarily 
congruent to diagonal ones: a classical result of Schur [15, 16] asserts that 

these are exactly the (possibly complex-valued) symmetric matrix. We state 
our conclusion as 

Lemma 2.1 (e.g. [12, Lemma 3.7]): Let C be a complex-valued symmetric 

matrix, C = C t . Then we have 


pc(C) = rc(C) = Nc(C). 


( 2 . 12 ) 


Several remarks are in order. 
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(i) Since the conjugate of a unit vector is another unit vector, the 
spectral norm N( # ) and its congruent-type analogue Nc(«) coincide - 
both will be denoted below as customary by II • II , 

N(C) = Nc( C) = IICII = Max |Cx|. (2.13) 

|x|=l 

Thus, the right-hand side equality stated in Lemma 2.1 reads 
rc(C) = IICII, or, written explicitly, 

Max |(Cx,x)| = Max I Cxi, C=C t . (2.14) 

1-1=1 1-1=1 

(ii) Let x be a particular vector at which the maximum on the left of 
(2.14) is attained. Then the equality asserted in (2.14) is a special 
case of the Cauchy-Schwartz inequality 

| (Cx,x) | _< | Cx | • | x | , | x | = 1. 

This, in turn, implies that the vectors Cx and x are parallel: the 

vector x is, therefore, necessarily a congruent-type eigenvector 

corresponding to a congruent-type eigenvalue X, 

Cx = Xx , 

such that | X | = pc(C) = rc(C). Hence, we obtain an independent 

derivation of the left-hand side equality stated in Lemma 2.1, which 
follows directly from the corresponding right one. We shall refer to 
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such X lying on the circle |z| = pc(C) as a congruent-type spectral 
eigenvalue. 

(iii) Once the existence of a congruent-type spectral eigenvalue was 
established, a different derivation of Lemma 2.1 can be argued. For, 

if X is a congruent-type spectral eigenvalue satisfying Cx = Xx, 

— vt * — . 

then by the symmetry of C, X is a congruent one for C , C x = Xx; 

hence C Cx = |x| x and, therefore, |X( equals p(C C) = IICII • 

Thus, we have shown that pc(C) = IICII and (2.12) follows. Indeed, the 

congruent-type eigenvalues of C are exactly the principle values of 

that matrix - they are uniquely determined up to a multiplication by a 

unit scalar. 

(iv) In [17], Turkel has shown that in order to calculate the numerical 

radius of a complex symmetric matrix C, it is enough to maximize the 
form | (Cx,x) | over the real unit ball; we may therefore write the 

numerical radius of such matrix 

r(C) =* Max | (Cx,x) | , (2.15) 

x € ]R n , | x | = 1 

while according to Lemma 2.1, the spectral norm is obtained by an 

extension to the (complex-valued) unit ball 

II C II = Max 

*€$ n ,|x|-l 


(Cx,x) 


(2.16) 
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3* The Spectral Norm of Symmetric Matrices 

The calculation of a matrix^ spectral norm, 

IICII = Max | (Cx,Cx) | 1/2 , 

W-i 

may prove itself as a complicated task due to the quadratic appearance of the 
matrix C on the right. In the symmetric case, Lemma 2.1 allows us, instead, 
to calculate the simpler congruent-type numerical radius 

rc(C) = Max |(Cx,x)|. 

M-i 

The relative advantage of the latter lies in its simple - linear form 

dependence on C, similar to that of the numerical radius 

r(C) = Max | (Cx,x) | . 

|x|=l 

In Section 4 we shall make use of this advantage, while verifying the 
strong stability of certain Lax-Wendroff difference approximations. To this 
end we first prepare the following proposition, putting Lemma 2.1 in a more 
convenient form. 

Lemma 3.1 : Let C = R + ij be a symmetric matrix with R and J 

denoting respectively its real and imaginary parts. We then have 


IICII 


Max 

lu| 2 +lv| 2 -l 


[ (Ru,u) + 2 | ( Ju,v) | - (Rv,v) ] 


(3.1) 
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Proof : Since C is a symmetric matrix, then by Lemma 2.1 its spectral 

norm equals its congruent-type spectral radius 

IIC I! = pc(C). (3.2) 

Turning to calculate the latter, we first observe that congruent-type 
eigenvalues are determined up to a multiplication by a unit scalar: indeed, 

the following equality is 0-independent 

Cx(0) = Ae^^xCO), x(0) = xe^, 0 <_ 0 <_ 2 tt. 

Let X be a congruent-type spectral eigenvalue which is assumed - without 
loss of generality - to be real 


X = pc(C) . 


(3.3) 


If x = u + iv is the corresponding congruent-type eigenvector 


(R + iJ)(u + iv) = X(u - iv), 


(3.4a) 


then equating real and imaginary parts yields 


R 

-J 


-J 

-R 


u 


u 


= X 


V 


V 


(3.4b) 
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Hence, X is a spectral eigenvalue of the real symmetric matrix on the 
left, C, 


X = P(C), 



-J 

-R 


(3.5) 


Furthermore, since C is a real symmetric matrix, then according to (2.6) it 
is, in particular, a spectral one, i.e., 


p(C) = r(C ) . (3.6) 

The equalities (3.2), (3.3), (3.5), and (3.6) imply 

IICII = r(C) = Max |(Ru,u) - 2(Ju,v) - (Rv,v)|; 

H 2 +|v| 2 =i 

choosing the sign of ±v with -(Ju,v) = |(Ju,v)| and exchanging between 
u and ±v if necessary, so that (Ru,u) > (Rv,v), the lemma follows. 

We remark that Lemma 3.1 can be generalized, formulating its conclusion 

in a more symmetric fashion. To this end, let us replace X in (3.4a) with 

i 0 

the congruent-type spectral eigenvalue Xe , 0 < 9 < 2tt . The same 
agruments, detailed above, lead to the equality 


IICII » r(C) C = C( 6) 


R( 9) 

— J ( 0) 

-J(9) 

-R(0) 


(3.7a) 
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where R(0) and J(0) are given by 

R(0) = cos0R + sin0J, J(0) = cos0J - sin0R. (3.7b) 

Consequently, the matrices R and J appearing on the right-hand side of 
(3.1), should be replaced with R(0) and J(0) respectively, yielding for 
arbitrary 0, 0 < 0 _< 2tt , 

II C II = Max |cos0[(Ru,u) + 2(Ju,v) - (Rv,v)] + 

M 2+ M 2 -l (3 .„ 

+ sin9[(Ju,u) - 2(Ru,v) - (Jv,v)]|. 


Lemma 3.1 refers to the special case 0=0. 

Using Lemma 3.1 we conclude with 

Corollary 3.2: Let C = R + iJ be a symmetric matrix with R and J 

denoting respectively its real and imaginary parts. We then have 

Hen < l / 2 Max [ (Rx,x) - (Ry,y) + /[(Rx,x) + (Ry,y)] 2 + 4(Jx,y) 2 ]. (3.9) 

M=M=i 

Proof : According to Lemma 3.1, the spectral norm of C = R + iJ is 

given by a maximal combination of the form 

(Ru,u) + 2 | ( Ju,v) | - (Rv, v) , | u| 2 + | v | 2 = 1. (3.10) 


We rewrite (3.10) in the following way: 
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2 2 
(Rx,x) sin <J) + 2|(Jx,y)| sin({) cos(j) - (Ry,y) cos (}>; (3.11) 

here x and y are the normalized unit vectors x = u/|u| and y = v/|v| 
with sinc() = |u|, cost}) = |v| whose squares are summed up to one. 

The result follows by computing the extremum of the expression (3.11) 
w.r.t. the argument <{>. 


4. Strongly Stable Symmetric Matrices 

In this section we examine symmetric matrices whose spectral norm does 
not exceed one: such strongly stable matrices are usually sought in 

connection with convergent difference approximations to partial differential 
equations. As an example, we shall utilize our results to conclude the strong 
stability of a certain Lax-Wendroff scheme. 

To begin with, we state the following sufficiency criterion. 

Lemma 4.1: Let C = R + ij be a symmetric matrix with R and J 

denoting respectively its real and imaginary parts. Then , C is strongly 
stable , II C II _< 1 , provided 

(Rx,x) 2 + (Jx,y) 2 <_ 1 - [ (Rx,x) - ( Ry , y ) ] • [ 1 - (Rx,x)] (4.1) 


for all unit vectors | x | = | y = 1 . 
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Proof : According to Corollary 3.2, strong stability follows if the 

inequality 

V 2 /[(Rx,x) + (RyVy )] 2 + 4( Jx,y) 2 £1 - V 2 [(Kx,x) - (Ry,y)] (4.2) 

holds for all unit vectors |x| = |y| = 1; see (3.9). By choosing x = y our 
assumption in (4.1) implies, in particular, that p(R) £ 1. Hence, the right- 
hand side of (4.2) is nonnegative, and the result follows by squaring both of 
its sides. 

Remark 4.2 : It is instructive at this point to compare the last strong 

stability criterion, with the requirement 

r(C) £ 1, (4.3a) 

which was originally used as a stability criterion by Lax and Wendroff in 

[11]. Setting K = I - R, the requirement (4.3a) for a symmetric matrix, C = 

C**, reads [ 11] 

(Kx,x) 2 £ 2(Kx,x) - (Jx,x) 2 , |x| = 1, (4.3b) 

while for strong stability 


IICII < 1, 


(4.4a) 


we need - according to Lemma 4.1 - the slightly stronger 
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(Kx,x) (Ky ,y) £ 2(Kx,x) - (Jx,y) 2 , |x| = |y| = 1. (4.4b) 

For a later purpose, we shall quote here an immediate corollary of the 
strong stability criterion (4.4b), stating 

Corollary 4.3: Let C = I - K + ij be a symmetric matrix. Then C is 

strongly stable , IICII _< 1, provided 

(Kx,x)(Ky,y) < (2K - J 2 x,x) |x| = |y| = 1. (4.5) 

The corollary follows upon employing Cauchy-Schwartz inequality to the last 
term on the right of (4.4b) yielding 

(2K - J^x,x) <_ 2(Kx,x) - (Jx,y)^. 

In the rest of this section we utilize Corollary 4.3 to verify the strong 
stability of a certain (modified) Lax-Wendrof f scheme [11]. The problem is 
governed by the strong stability of a so-called amplification matrix given by 

C = CU,n) - I - K + iJ; (4.6a) 

here K and J are polynomials in the real symmetric matrices A and B, 
which take the form 


J - J(£,n) = sin£*AA + sinn*yB 


(4.6b) 
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K = K(£,n) = V2[(<* + 6)(aX 2 A 2 + $y 2 B 2 ) + J 2 ], a=l-cos £, $=l-cos ri . 


Our purpose is to show that for sufficiently small scalars X and 
amplification matrix C(£,n) in (4.6) is strongly stable for all £, 

0 < £,n < 2ir. 

Using the abbreviations 


= a(x) = X Ax , b = b(x) y|Bx|, |x| = 1, 


we find 


2 2 2 2 2 
(J *x,x) < sin £*a + sin n»b + 2sin£*sinrrab 


with the last term on the right not exceeding a value of 


2sin£* sinn*ab _< (1 “ cos£)(l + cosri)a^ 


I I / V 


Inserted into (4.6c) we arrive at the essential estimate 

(Kx,x) V 2 [ (a + 3)(aa 2 + Bb 2 ) + a(2 - a)a 2 + 3(2 - 3)b 

+ o(2 - 3)a 2 + 3(2 - a)a 2 ] = 2(aa 2 + $b 2 ) 


In their original treatment, Lax and Wendroff have employed a 
different estimate of the same term [11, p. 392], 


(Ky,y) £ (/a + /&)»(/aa 2 (y) + /fjb 2 (y)), 


(4.6c) 
y, the 

n, 


(4.7) 

somewhat 


which yields 
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(Ky.y) < /2«(a + 0)*[a 4 (y) + b 4 (y)] 1/z . (4.8) 

The last two estimates provide us with the necessary upper bounds on the two 
terms appearing on the left of (4.5); regarding the right-hand side of (4.5), 
we have in view of (4.6c) 


(2K - J 2 x,x) = (a + 8) •( aa 2 + 0b 2 ). 


(4.9) 


Hence, Corollary 4.3 yields strong stability provided the inequality 


[ X 4 I Ay | 4 + y 4 1 By | 4 ] ^ « + 3) »(cxa 2 + gb 2 ) 

/2»2*(a + 0)(aa 2 + 0b 2 ) 


hold for all unit vectors |y| = 1. 

We summarize what we have shown in 


Theorem 4.4: The Lax-Wendroff scheme (4.6) is strongly stable provided 

the so-called CFL condition is fulfilled 


8(X 4 A 4 + y 4 B 4 ) _< I. 


(4.10) 


The strong stability condition derived in (4.10) turns out to yield a slight 
improvement over the strong stability condition obtained for this case by 
Abarbanel and Gottlieb in [1], requiring 


4 Max(X 2 A 2 ,p 2 B 2 ) < I. 
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The two conditions coincide whenever XA = yB in which they agree with the 
somewhat more permissive Lax-Wendroff condition [11 , Theorem 4*4] requiring 
2( X A + y B ) < I. The point we make here is that our general algebraic 
criteria for strong stability - consisting of Lemma 4.1 and its stricter 
version in Corollary 4.3 - are both sharp enough for the purpose of studying 
the stability question in a rather systematic way, replacing the brute force 
proof employed in [1]. 
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